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Khachian’s  Algorithm.  1'or  Linear  irograraming 
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Abstract. 

L.  G.  Khaeh i an '  s  algorithm  to  check  the  solvability  of  a  system 
of  linear  inequalities  with  integral  coefficients  is  deser'bed.  The 
running  time  of  the  algorithm  is  polynomial  in  the  number  of  digits 
of  the  coefficients.  It  can  be  ajjlied  to  solve  linear  programs  in 
I  o  ly nor.  i  al  t  ime . 
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L.  G.  Khachlan  [ Doklady  Akademii  Nauk  S5SR,  Vol.  2UU,  No.  5, 

1093-1096 1  published  a  polynomial -bounded  algorithm  to  solve  linear 
programming.  These  are  some  notes  on  this  paper.  We  have  ignored 
his  considerations  which  concern  the  precision  of  real  computations, 
in  order  to  make  the  underlying  idea  clearer,  on  the  other  hand,  proofs 
which  are  missing  from  his  j aper  are  given  in  an  appendix, 
bet 

(1  ,l;x  '  b =  1, . . . ,  n  ,  a.  f  /  ,  b.  f  7,' 

be  a  system  of  strict  linear  inequau.1* ies  with  integral  coefficients.  We 
I  resent  an  algorithm,  which  decides  whether  or  not  (1  is  solvable,  and 
yields  a  solution  if  it  is. 

Define 

L  «  y .  log  ( |a.  .  |  ♦  1  ♦  £  log  (  lb  |  *  1  ♦  log  nm+1 

i»J  J  i 

L  is  the  sjace  needed  to  state  the  problem. 

The  Algorithm. 

We  define  a  sequence  x  , x., ...  •  Rn  and  a  sequence  of  symmetric 
jorltive  definite  matrices  A  ,  A., ,  . . .  recursively  as  follows. 

is  defined.  Check  if  x. 

is  a  solution  of  (1  .  If  it  is,  sto] .  If  not,  pick  any  inequality 

\ 

in  '’l)  which  is  violated: 

*i\  ;  bi  > 


*0 


Assume  that  (x 


k’ 


V 


2 


on  1  set 


1  Vi 

Vi  -  Xk-Ku  J== 


(Note  that  the  multiplication  of  vector  A,^a.  with  itself  in  the  second 
terr.  results  in  an  n  %  n  matrix.) 

In  jractice,  we  will  cor.jute  only  certain  approximations  of  x^ 
and  A,  by  decimals  of  a  certain  jrecicion.  It  can  be  shown  that 

it 

approximations  within  exj(-lOnL)  preserve  the  validity  of  the  following 
theorem. 


TV.'-or-T..  If  the  algorithm  stoj  s,  x^  a  olution  of  (1  .  If  the 
-jig  r i.  •  .  not  .  toj  in  ;  tep-s,  then  (lx  la  not  solvable. 


The  first  assertion  i:,  of  course,  Just  a  repetition  of  the  stopping 
rule  for  the  algorit hr..  To  j  rove  the  crucial  second  statement,  we  shall 
need  a  series  of  l<Tr:as,  along  v.th  a  geometric  description  of  what's 
ha; ;  ening. 

Let  x  r  R“  and  A  a  positive  definite  matrix.  Then 
(x-x  )‘A_1(x-x))  <  1 

defines  ar.  cllijsoid  E  *  (x,A)  with  center  x  .  Let  a  r  Rn  ,  a  *  0  . 

£ 

Then  we  shall  ionote  by  E  the  cllijsoid  (x^,A'  »  where 

,  1  a 

xo  ■  *0  *  n*i  A  rr~  * 

Va  lAa 
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2  Aa  ' ;  Aa 

n»l  T, 
a  Aa 


)  • 


We  shall  denote  the  semi -ellipsoid 


E  r  (x;  (x-x  )a  <  0} 


t-y  I  E, 


Let  us  remark  (although  this  is  not  needed  in  the  j roof )  that 
geonetriCally  this  construction  mean:  the  following.  Take  a  hyperplane 
ax  «  d  ,  d  <  ax  ,  which  is  tangent  to  F.  at  point  y  .  Then 


!io>  F'1  will  be  the  (uni  ;u«-  ell i j  soi  i  which  touches  the  hyperplane 
ax  b  d  at  y  and  intersecti  the  hyperplane  ax  «=  ttx  in  the  same 

ellipsoid  as  E  . 

.'o  here  car.-  the  lemma: .  The  first  three  are  fact,  of  number- 
theoretic  nature  which  probably  are  familiar  ti  many  jeojle  who  have 
mrertigated  tta . plex  of  algorithmic  problems  in  linear  algebra. 

r—  p' 

We  use  the  notat  ion  lx  I  »  max  x,  ,  lx  I  ■  .2  x.  . 

1  '«D  ^1  '  'i. 


Ler-na  1.  'very  vertex  v  of  the  polyhedron 
a  .  ^ :  i 1  »  1,  ...,m 

x  >  0 

satisfies  |v|^  <  n  ,  and  its  er.tr>.  -ire  rational  numbers  with  denominat  r 
at  most  2^  . 


Lota  If  1  has  a  solution,  then  the  volume  of  it.  solutions  inside 

the  cube  |x.  |  <  2^  is  at  least  ?“n;'  . 


I 


Lemma  ' .  Su ppose  that  the  system 

,-L 


aiX  <  bi  +  ? 


(i  =  1, . . . ,m) 


has  a  solution.  Then 


a.x  < 


(1  =  1> 


has  a  solution. 


Lemma  i* . 


h  K  C  Ea 


Lemma  ‘p.  \(Ka)  «  c(n)\(E)  , 


vher<- 


c(n 


_n_  -(l/P(nU)) 

n*l 


an!  l.(X  i.  the  volume  of  the  set  X  . 

The  i  roof  of  the  theorerr.  i;  juite  easy  now.  :'upjose  that  the 

o 

pr  ■■  IMS  not  St 01  after  k  ^  •  -t  (1  i.  solvable. 

•Hier.  by  Lerrui  .  ,  the  ret  i  of  it;  solution;  x  inside  K  has 
'•(5  >  P  *  "  .  By  Lesssa  1.,  1  c  ?y  .  But  by  Leur.a  5» 


‘<S> 


-(k  'P(n-l)) 


-(k  P ( n+1 ) )  _PLn 


-nL 


a  contradiction. 

Tf  one  would  like  to  decide  the  solvability  of  a  system  of  the  form, 
i  b<  (i  «  1» . . .#n) 


then  we  may  consider  instead  the  system 

(5)  f PL1  a. x  <  rPL'b,*l  (i  -  l,...,n)  . 
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By  Lemma  3,  this  is  solvable  iff  (2)  is  solvable. 


I*  Wt"  wailb  lo  solve  a  linear  programming  problem 
T 

maximize  ex 
subject  to  Ax  <  b 

x  >  0 

then  consider  the  system  of  inequalities 
eTx  .  bTy 


Ax  <  b 

x  >  0 

T 

Ay  ^  c 

y  >  o  . 


This  is  solvable  iff  the  original  j rogran  has  a  feasible  solution 
a  finite  optimum,  and  for  any  solution  (x,y)  of  this  system,  x 
an  ojtimal  solution  of  the  jrogram. 


and 

is 
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A}  pendix 


1  roof 

o!* 

LOflUlfi 

JL.  Let  v  =  (v^,  .../V^)  .  By  Cramer’s  rule,  each  v\ 

can  be 

exp  reset 

?d  as 

vi  ■ 

■  D1/D  , 

where 

Di 

and 

D  are  determinants  whore  entries  fire  0  ,  1  ,  a.  .  or  b. 

i  J  i 

Hence 

D 

and 

.are  integers,  ur.d 

M 

>  1  , 

M 

<  TT  (norms  of  row  vectors' 

<  21 

nr.  <  2^  n  , 

•ad  the  .  'vr.'-  hold.-  for  the  J.  V.  7».  ■  .  .  r.j  ]  . .  • .  .a.  .  ■••rt  :  on. 

•  roof  :  I/'rr.a  .  We  may  assume  that  1  has  a  solution  x  >  0  .  f© 
the  polyhedron 


( 


a.x  v  bi  i  .  !»••.»» 

x  '  0 


har  an  interior  joint.  Cince  it  contain,  no  line,  .  t  also  has  a  vertex 
v  =  (v^,...,vr  .  By  Iscrzerji  1,  we  Know  that  v.  <  .  "  n  <  # 

follow?  that  the  polyhedron  (1  har  an  interior  joint  x  *  (x^,...,x) 
with  xt  <  ,  and  ro  the  polytope 


(5) 


(i  =  1, 


>») 


«  1, . .  .,n 


har  an  interior  joint.  Hence,  it  har  n+1  vertices  v  ,...,v,.  which 
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are  not  on  a  hyperj  lane 


So  (5)  ha;-  volume  at  least 


_1_ 

nl 


Here,  by  L«3nma  1,  we  get  that 


v 


i 


» 


where  u 


is  an  integer  vector  and  Is  an 


integer  <  2  /n  . 


r_nL.n!1 


So 


.  ■  ■  ■■■  i'-t  !T.i:;ax:t  . tha  se  nd  expression  it  a  :  n-zert  Integer. 

i  .nTrj  •fit 

tb  v  Ltw  -  the  ;■  Lytope  at  Least  — j-  n  ...  , 


in--1!'  --rra  *  .  for  x  <  R"  ,  set 

V*  *  v  *  bi  • 

Let  x  r  k  ■  art  .  t  rary . 


’lair.  1. 

Ther*-  exists  an 

c  Rn  £ 

uch 

that 

(1) 

^(x.  <  max(0. 

6>j(x  )) 

(i  - 

1 1  •  •  •  p  r» ' 

and 

(2) 

The  vectors  (a^: 

*i(xl  - 

0} 

spar. 

•  v  r .  ■  1  hi  r  net  or  a 

To  j  rove  the  clair.,  it  suffices  to  show  that  if  x  does  not 
satisfy  (f  then  w**  can  find  a  vector  x^  such  that  x^  saticfiec  (1) 
and  <*.  (Xj  ^  0  holds,  for  more  indices  i  than  w.  (x  )  ►  0  .  Repeating 
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this  at  most  m  times  we  must  obtain  an  Xj  satisfying  both  (1' 
and  (2). 

Let,  say  ;  x  ;  x  j  ,  ^  x  ,...,w^(x  •»  . 

Suppose  that  a  (v  >  k)  is  not  a  linear  casbinatlon  of  h^, ...,ak  . 
Hi  on  the  systar.  of  linear  equations 


a,  y  *  ( i  ■  1,  • . k 

a  y  a  1 
v 

.  .  iv  -t:  la.  Let  be  a  solution  and  c<  ni  b  r 

x,  *  X  *  ty,  , 


where 

t  «  nax lr  r  F'  sa .y  ♦ 

J  ^ 

•  finite,  i  fad  *  •  -~ 

—  V 

Then  l;.  the  ;h  ice  of  t  , 


.  *  k*l, ...,m  ) 


•*  ( X 


ta  y  ♦  d  (x 


0.  (x  1  <  i  <  k  f 


<  0 


k+ 1  <  i  <  c  , 


an  I  jusl  *  bolds  for  at  leai  t  oni  1  <  1  <  ■  .  Ib  ]  r  v  s  th<  .  .  ■ 

Assume  now  that  x  i ;  such  that 

„T 


ai*0  <  bi 


■.  =  1  f  •  •  •  »R 


Let,  say  a,x  •  fcj  for  =  1,  ...,k  .  Cboose  the  labelling  so  that 
a^»*»-»ar  are  linearly  independent  but  a^4 a^,  are  s}  anned  by 
them.  By  the  Claim,  we  may  assvne  that  a^, . . . ,  a^  ar-'  also  rjanned 

by  a^, • • •>  ar  • 


o 


Nov  let 


be  a  solution  of  the  system  of  linear  equations 


%i*  K  bi  i  •  !>...»* 


We  show  that  z  satisfies 


V  S  h 


for  every  1  <  i  <  a  .  We  Know  that 


r 


'i  -  - 

1  J.l  '  J 


with  .  bm  real  mat] art  .  .  in  fact  by  framer*  i  rul<  we  aim  i«im 


V  *  YD  ’ 


where  D  and  I  ar-  determinant.;  for-  ej  by  some  entries  of  the  vect .  rs 


a  ••  ‘ ar<  integeri  with  ibi  lut<  v«lu<  Leei  than  :  . 


D(a. ::  -  b 
1  2 


J-l  -  u 

r 

t  - 

•  i 

J.l  J  *■' 


i 


T1  est  ..-.ate  the  right  hand  .  :dc,  use  that 

r  r 


.  •  :  .  ■  • '  v  -- * 


,  -  Z  -  » 

J.l 


<  d.;‘-  ♦  Z  |?j|  i  > 


J.l 


and  since  the  left  hard  ride  ir  an  integer, 

r 


Z  D,b,  -  Db.  <  0  , 

.  1  J  J 


which  trove,  the  assertion. 


i  roof  ot‘  Lcraaa  •• .  We  may  assume  that  x  =  »  A  *  1  (i.e.>  the 

T 

ellipsoid  is  the  unit  sphere  about  0  )  and  that  a  »-  -1,0,  , 

since  the  contents  of  the  lesma  is  invariant  under  affine  transformations 
of  the  sjaee. 

Then 


x- 


("•i  ’  ’  ) 


OJli 


A’  -  di 


(  ,  .*  1 

ag  -  .  -  ,  ,  -  I 

^  (n*l  '  n  -1  n  -1  J 


X(r  E  •  Ihn  |x  |  _  1  >  1 


•  5,  •  -n‘x  _•  0  .  We  have  to  show 


that 


T  ,  _  } 

(x-x'  'A  "  x-x’  •_  1 


Hut 


T  ,  .1 

(x-x'  'A  x-x' 


.  x ‘A  _1x  -  x ' A  "x'  ♦  x''a’  *x' 


n‘  -1  2  2d* 


n*  I 
n' 


n 


,  .1  .  ?1  ?i-i  ♦  1  <  1 


•  roof  of  .  W<  ray  assume  again  that  E  is  the  unit  sphere 

•d  ai  :  a  .  1,  .  1  ,  since  affine  trans fornati on.  U  not 

change  the  proportion  of  volumes.  By  a  well-known  formula, 

..(P'S  .  i4===-  ♦  ’»( E)  =  %/dctA’  \(K) 
v  det  A 


n 

n*l 


(n-l)/2 


c(n).s(K) 
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To  estimate  this  factor  use  that 


1  ♦  -L-  <  .Vln'-l) 

n'  -1 


1  -  i  <  e-1""*1) 

n+1 


■Ufcstituting  these  bounds  we  get 


,(.)  <  ,-ww»  . 


